LJ These slides/notes represent only part of the course, and were 
accompanied by face-to-face explanations on white-board and 
additional topics / learning materials. 


LI In preparation of these slides | have also benefited from various 
books and online material. 


LI Some of the slides contain animations which may not be visible 
in pdf version. 


LJ Corrections, comments, feedback may be sent to 
httos://www.linkedin.com/in/naveedrazzaqbutt 





FE 322 
Digital Communications 


with 
Dr. Naveed R. Butt 
@ 


Jouf University 


Introductions ... 
«Me 


° You 
¢ The Course 
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Important Business!! 


¢ 75% attendance is mandatory! 


¢ Textbooks 
¢ Simon Haykin, “Digital Communication Systems”, 1st Edition, 2013. 
¢ John Proakis and Masoud Salehi, “Digital Communications”, 5th Edition, 2007. 


¢ Contact 


¢ nbutt@ju.edu.sa 
¢ office: 1140 
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Learning Plan 


Assignments 


5% 


¢ Lectures 
¢ Help discover and grasp new concepts 

. Quizzes ; Sol T— Mid-Term 1 
¢ Help prepare/revise each week’s concepts ey aay) 10% 





¢ Keep you from lagging behind in course 


¢ Assignments 
e Learn to solve involved problems based on course 


¢ Course Project 
¢ Helps learn independent work & presentation 
¢ Prepares for final year project ve entree 


° Exams 
¢ Help prepare entire course material 





Quizzes 


sey 10% 
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What are some of our common daily 
activities? 


What are some of our common daily 
activities? 
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What are some of our common daily 
activities? 


¢ Eating 
¢ Drinking 
¢ Sleeping 


¢ Communicating!! 


“Communicating” is an important human 
activity!! 


“Communicating” is an important human 
activity! 





Bates 





6 6 
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“Communicating” is an important human 
activity!! 


¢ Instances of your communications today 
¢ Prayer call 
° Greeting family 
¢ Car honking 
¢ Car indicators 
¢ Waving to a friend 


¢ Listening to this lecture... 


How have humans been communicating? 


How have humans been communicating? 


CARTOONSTOCK 


mrielin) 


RY 
SS .Sezrch 
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How have humans been communicating? 


Aeronautical 
Communications 








h 
4 


GPS - 
Navigation 
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How have humans been communicating? 


¢ Gestures (hand signs etc.) 

¢ Verbal (talking) 

¢ Drawing (cave walls, earth) 

¢ Writing (clay, leaves, paper) 

¢ Smoke/Gong Signals 

¢ Mail (on foot, horses, ships, trains, planes, smaller vehicles) 
¢ Electric Current (telegraph, landline telephone) 


¢ Electromagnetic Waves (wireless communications) 


What are the most distinct features of 
modern communications? 


¢ Uses electric current or electromagnetic waves! 
¢ Long distance 

° Fast 

° “Digital” 


¢ What is a “digit” ? 
¢ Latin: Finger (used for counting) 
¢ Binary: O or 1 (ON or OFF) 
¢ Decimal: O, 1, 2, 3, 4, 5, 6, 7, 8,9 


¢ Analog vs Digital 
¢ Analog 
* Continuous 
° Digital 
¢ Represented by fixed limited values (usually binary) 
° Typically involves electronic sensors, digitizers, digital logic. 
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The 





“digital” in Digital Communications 


PT 


Vee 






LCD MODULE s 
Vee 


s9C51 


a 
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The “digital” in Digital Communications 


¢ Why go “digital” ? 

¢ More robust to noise and interference 

¢ Easier and wider range of signal processing (using digital logic) 
¢ Any downside? 

¢ Processing and digitization can take time 

° Typically requires more bandwidth compared to analog 


Let us write a letter ... 


¢ The thoughts are coming from your mind, you are the source 


¢ The letter is meant for communicating your thoughts to someone - 
the target (desired user) 
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Let us write a letter ... 


¢ You use symbols (characters) to represent your thoughts 
¢ The desired user should be able to understand those symbols!! 


¢ You use the postal service to arrange the delivery (sending/receiving) 
of your letter 


CTC FC eee | 
ewww 3 2 2 8 
barf €LLE 
cso »mof dy a4 
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Let us write a letter ... 


¢ The postal service uses some physical medium or “channels” 
(land/air) to transport your letter 


¢ The postal service user various containers that protect the letters 
from dangers on the way (e.g. rain, getting torn or mixed up) 
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Elements of communication ... 


Source of 
information 
Message 


signal 


¢ Source/Target 





Communication System 


| 
Estimate of 


message 
signal 





Transmitted Received 


signal signal 





* (generator and desired user of information) 


° Transmitter/Receiver 


* (mechanism to help deliver information from Source to Target) 


¢ Channel 
* (physical medium used) 
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User of 
information 


23 


Elements of digital communication ... 


Message signal 


Estimate of 
message signal 













User of 
information 


Source of 
information 


Source 
encoder 









Estimate of 
source 
codeword 


Source 
codeword 





Channel 


| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
Channel | 
| decoder 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 









| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| Receiver 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 


| ‘dium used) o— encoder 
¢ Modulation = Estimate of 
deword 
* (analog symbols used for transmission) one codeword 
. Encoding Modulator Demodulator 
¢ (steps taken to protect the symbols during transmission) | 
De a ae ee 


Received 
signal 









Waveform 
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Back to the letter ... 


¢ With your letter, what are some of the most desirable aspects? 


¢ High Quality - The message you wanted to convey should reach the target 
without changes 


¢ High Speed - Delivery should be fast 
¢ Low Cost - Delivery should cost as little as possible 
¢ Security — Your letter should not be given to wrong person 


¢ This is more or less what we want in digital communications as well!! 


Some common challenges in digital 
communications 


¢ Channel Effects (noise, fading, scattering etc.) 
¢ Processing Times 

¢ Power Consumption 

¢ Security and Privacy 


In this course we will see ... 


¢ How to write signals in mathematical form (for analysis and design) 


¢ What are the different symbols we can use for digital 
communications 


¢ How can we protect the signals from channel effects 
¢ What are some of the ways of receiving the transmitted signal 
¢ What have scientists learned about the transmission of information 


Questions??? Thoughts? ? 


° 


e 
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Some familiar terms ... 


¢ Probability 

* Gaussian Noise 

¢ Fourier Transform 

¢ Power Spectrum 

¢ White Noise 

¢ Linear Filters and Convolution 


What is “probability” ? 
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What is “probability” ? 


¢ Probability is a “lack of knowledge”! 
¢ We know you are here today. We are sure. 


¢ But will you be here in the next lecture? We are not sure anymore! There is 
now a “lack of knowledge” 


yy Mt yy lt 


* “perhaps”, “maybe”, “probably” 


Why do we sometimes lack knowledge ? 


What An Electron Isn't 
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Why do we sometimes lack knowledge ? 


¢ Future 
¢ A dice you haven't rolled yet 
¢ How can we know which number it will show! 
¢ Too hard to collect all the information 
¢ Which places did you visit today? 
¢ It may be possible to have a drone camera follow you all the time. Then we will not have 
“lack of knowledge” about places you go to. But this is too hard a thing to do. 
¢ Quantum randomness 


¢ Where’s the electron? 


¢ According to current consensus, processes and properties at quantum level are 
probabilistic by their very nature. 


Why study probability ? 
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Why study probability ? 


¢ Height of the next student who enters the room. 


Why study probability? 


¢ Height of the next student who enters the room. 





Number of People (1000s) 
~ 
° 






Women with? 
“Male” Height 


0 ps : 
140 145 150 155 160 165 170 175 180 185 190 195 200 


with 
“Female” Height 


Height (cm) 





54cm-—251 cm 
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Why study probability ? 


¢ Height of the next student who enters the room. 
¢ There is lack of knowledge about it! 


¢ But that lack of knowledge is not “absolute” 


¢ We do know something about the heights of humans and can make some “guesses” 
based on whatever information we have (based on observation, experience, statistics) 


¢ Such guesses can help us design the height of the doorway (for instance). 


Probability theory helos us make sense of an 
uncertain world! 


¢ It helps us make smart guesses about uncertain events 


¢ Based on the smart guesses we can plan, design, or take steps to 
better control the situation 


Better design with probability! 


Percent within two inches 














Only around 16% of 
students will be able to pass 
through a door of height 
5’7” without bending. 


Almost 98% students will be 
able to pass through a door 
of height 6’4” without 
bending 








61 62 63 





39 5710 S711 670 


Height 


49 50 S51 52 53 54 55S 5 577 58 64 65 66 67 68 
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“| hate this course” 
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“| hate this course” 


¢ Suppose we record your voice saying this three times. 
¢ The three recordings will not be exactly the same 


¢ But we are still able to hear them and say that they belong to same person 
and what the person is saying 


¢ This means that there are some “common” or “fixed” underlying features in 
the recordings! 
¢ Probability theory helps us understand the fixed aspects (mean, 
variance, covariance etc.) of uncertain processes. 


¢ This “understanding” helps us design efficient systems 
e E.g. Soeech and voice recognition for Siri, Google Assistant etc. 


Using probability in communication 


a Probability of receiving “ta” when “za” is sent 


P (& | &) = High!! 
P (4 | €) 


Low!! 


Lesson: perhaps we should not use symbols that are too 
similar (close in some sense) to each other! 


cCoe2”7°7 Niaital Camr nIieati ne Jn Nia\snan PR Riitt fF) Llinisarcity 
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Using probability in communication 


Noisy 


Channel 
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Some familiar terms ... 


¢ Probability 

* Gaussian Noise a 

¢ Fourier Transform 

¢ Power Spectrum 

¢ White Noise 

¢ Linear Filters and Convolution 
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Gaussian Noise = a noise process that follows 
the Gaussian distribution 


¢ Noise? 
¢ Something unwanted! 


¢ You are talking to your friend, cars are passing in the background, the traffic sounds are 
“noise”. 
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Gaussian Noise = a noise process that follows 
the Gaussian distribution 


¢ Noise? 
¢ In digital communications, we usually represent unwanted effects or signals 
that show up during communication as “noise” 


¢ Our typical goal in digital communications is to reduce the effects of noise 


Signal 


a 
SY Signal + Noise 


[sy 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Gaussian Noise = a noise process that follows 
the Gaussian distribution 


Information Transmitter 
Source 


Message 


Receiver Destination 


Message 









EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Gaussian Noise = a noise process that follows 
the Gaussian distribution 


¢ Distribution? 
¢ A distribution is a collection of probabilities we assign to random events. 


¢ Collection? Graph, table, function / 
1/6 
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Gaussian Noise = a noise process that follows 
the Gaussian distribution 


¢ Gaussian? 
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f(x)= Distribution Normal Distribution 










A large variety of random 
events follow a “bell” shaped 
i averadiviele distribution called the Gaussian 











Distribution 
Hl Low Marks High marks 
l@ Very low marks Very high marks 


Marks 


Why Gaussian? 


° Common 


¢ Random events often follow the Gaussian distribution 
° E.g., heights, ages, marks etc. 


Why Gaussian? 


¢ Central Limit Theorem 


¢ The collective effect a large variety of random events is often Gaussian! 


0.150} 0.150 | 
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Uniform distribution 


slowly becoming 
Gaussian! 
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Why Gaussian? 


° Convenience 


¢ It is easy to model and work with (often a good “simplification” ) 
¢ Completely specified by mean and variance (or covariance) 


What/Who is Gauss anyway? 
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Considered by many to 
be the greatest 
mathematician ever!! 


(Germany 1777 - 1855) 


Some familiar terms ... 


¢ Probability 

* Gaussian Noise 

¢ Fourier Transform <a 

¢ Power Spectrum 

¢ White Noise 

¢ Linear Filters and Convolution 
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Let us bake a cake ... 


¢ Suppose you are a great chef who always likes to see baked things in 
term of their ingredients 


Flour 1 cup Mix flour and milk .... 
Milk 1 cup 
Sugar 0.25 cup 

Egg 3 
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Fourier Cake! 


¢ In Fourier Transform, we want to look at signals in terms of a fixed set 
of ingredients 
¢ Ingredients : Sinusoids of different frequencies 
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Fourier Cake! 


¢ In Fourier Transform, we want to look at signals in terms of a fixed set 


of ingredients 
¢ Ingredients : Sinusoids of different frequencies 


Amplitude 





Time 


Fourier Cake! 


¢ In Fourier Transform, we want to look at signals in terms of a fixed set 
of ingredients 
¢ Ingredients : Sinusoids of different frequencies 


Ingredient Amount 
(sinusoid aaa — 
+ Add all 


— : 0.5 
ie 0.25 
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Fourier Transform 


¢ How is this shown after Fourier transform? 





Scaling 
Ingredient Amount 
+ (sinusoid frequency) — 
5 Hz Add all 
10 Hz 0.5 
+ 15 Hz 0.25 2 
0.25 


5 10 15 
Frequency (Hz) 
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Fourier Transform 


¢ How is this shown after Fourier transform? 


Amplitude 


Time 
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Fourier Transform 


Inverse 
Fourier Transform 
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Scaling 


0.5 
0.25 


5 10 15 
Frequency (Hz) 


(mA) | fl inivarcityv 
@ Jour University 


Fourier Transform 


¢ Another example 


Magnitude 





Time 
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Frequency 


Why transform from time to frequency? 


a. Measured signal 





0 32 64 96 128 160 192 224 255 
Sample number 


0 10 20 30 40 50 
Frequency (hertz) 
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60 





80 
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Why transform from time to frequency? 


¢ Many natural processes (e.g. vibration, rotation) are periodic (cyclic) 
in nature. It is good to represent them by frequency. 
e Examples: sound waves, electromagnetic waves. 
¢ By writing signals in frequency domain, we can play directly with the 
frequencies. 


Longitudinal Wave 
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Why sinusoids? 


¢ Sinusoids provide a good model for vibration and rotation 


¢ Sinusoids are smooth functions and are mathematically easier to 
work with 


e E.g., derivative of a sinusoid is also a sinusoid, and integral of a sinusoid is also 
a sinusoid 


Questions??? Thoughts? ? 


° 


e 
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In the last lecture we saw that... 


¢ Probability is a lack of knowledge. 


¢ Randomly varying or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


If this does not change over time then the 
random process is strictly stationary 


Probability distribution 


vo 


Mean. Variance, Covariance <—— If these do not “vary” over time then the 
} } 


random process is weakly stationary 
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In the last lecture we saw that... 


¢ Probability is a lack of knowledge. 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


If this does not change over time then the 
——- . e e 
random process is strictly stationary 
; If these do not “vary” over time then the 
i random process is weakly stationary 


Today’s topics 
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But first ... 


¢ Let us be clear about what we mean by a random “process” 


¢ Arandom process is a series of random events 


¢ Can be discrete (student heights) or continuous (voice) or discretized 
(digitized voice) 


x Height of next student 
ee who enters the room 
Random 
Event/Variable 
Heights of next eight 
—— [X, X, X3 Xy Xs Xe Xy Xg students who enter the room 


Random Process 
(discrete) 
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But first ... 


¢ Let us be clear about what we mean by a random “process” 


¢ Arandom process is a series of random events 


¢ Can be discrete (student heights) or continuous (voice) or discretized 
(discretized voice) 


X(t) Human speech 


4 


Random Process 
(continuous) 





—_, [X(ty) X(t.) X(tg) X(ty) X(ts) X(te) X(ty) X(tg)] Samples taken at 


times t1, t2, ..., t8. 
Random Process 
(discrete) EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Our friends in an uncertain world! 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


nee aa ; If this does not change over time then the 
Probability distribution random process is strictly stationary 


vo 


Mean. Variance, Covariance <—— If these do not “vary” over time then the 
random process is weakly stationary 
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Distribution? 


¢ A distribution is a collection of probabilities we assign to random 
events. 
¢ Collection? Graph, table, function 


Probability 
o Oo 9 oO Oo 935 9 
oO a Oo 1 See, eae an 
eB GF @8@ = HB F®§ DF 


Oo 
o 
Nn 





1 = a 4 a 6 
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Distribution ? 


¢ A distribution is a collection of probabilities we assign to random 


events. 
¢ Collection? Graph, table, function 


f(x)= Distribution Normal Distribution 

Note: For the distribution to 
be valid, the assigned 
probabilities must follow the 
three axioms of probability! 





Average Marks 





e.g., assigned 
8 High marks probabilities should 
not be negative. 


fi Low Marks 








@ Very low marks ) Very high marks 


Marks 
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Probability distribution — how to decide the 
“shape” ? 


Number of students 


—_@-0- ete eee fe se __- 


Student Marks 
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Probability distribution — how to decide the 
“shape” ? 


Number of students 


Student Marks 
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Probability distribution — how to decide the 
“shape” ? 


Number of students 


— agifi: &° e020 __- 


Student Marks 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Probability distribution — how to decide the 
“shape” ? 


Number of students 


© 0 « @ gi 


Student Marks 
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Our friends in an uncertain world! 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


= 2. . If this does not change over time then the 
Probability distribution random process is strictly stationary 


v 


Mean. Variance, Covariance <—— If these do not “vary” over time then the 
, random process is weakly stationary 
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Many names: Mean/Average/Expectation 


Mean = Center of mass for the distribution (balancing point) 


Number of students 





Student Marks 
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Many names: Mean/Average/Expectation 





Mean = Center of mass for the distribution (balancing point) 


Number of students 


— GG o° wow, 0 


Student Marks 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Many names: Mean/Average/Expectation 





Mean = Center of mass for the distribution (balancing point) 


Number of students 


— ei @° 0a 0 


Student Marks 
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Many names: Mean/Average/Expectation 


Mean = Center of mass for the distribution (balancing point) 


Number of students 





eco er eRe 0 a0 0 


Student Marks 
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How do we write the “mean” mathematically ? 





Discrete case Continuous case 
Hx =E[X] = xpy) Hy = E[X] = | Xfy(x) dx 
| a Probability 
E[2e(X)] =) 9px) E[g(X)] = | g(x) fy(x) dx density function 


HX (ft) = E[X@)] oe ee 
P(X = x) 
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Example 


¢ Rolling a die 
° glx] = 2x 
¢ Rolling a die five times 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


What are some of the important properties of the 
“mean” ? 


Sa re [X.]) 


=] 


Only if X and Y are 


IE [XY] = E [X]E[ Y] —s 


More on this later 
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Our friends in an uncertain world! 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


= 2. . If this does not change over time then the 
Probability distribution random process is strictly stationary 


vo 


Mean. Variance. Covariance «<—— If these do not “vary” over time then the 
random process is weakly stationary 
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Variance = degree of spread (how much 
variation is there in the data/outcomes?) 


Medium variance 


ahaa 


High variance 


Chocee Sp 
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Low variance 





How do we write “variance” mathematically ? 


Discrete case Continuous case 


var[X] = E(X-w,) var[X] = E(X- 4“) 


J 


9 
(x - Hy ) fy(x ) dx 


> Ge= Hy)? Px) 





var[X] = E[X7] Ts 
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Example 


¢ Rolling a die 
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Our friends in an uncertain world! 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


= 2. . If this does not change over time then the 
Probability distribution random process is strictly stationary 


v 


Mean. Variance, Covariance <——— If these do not “vary” over time then the 
random process is weakly stationary 
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Covariance = degree of linear relationship 
between data/outcomes 


4000 


3500 


Can knowledge of one 
random process help us say 
something about the value of 
another? 


3000 


AC Power [W] 
no 
2 


Yes — if their covariance is - 
. 
2014 








Air conditioner 


/™» 


Time 
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—— Outdoor temperature 


40 


[ \ \35 


Temperature [°C] 


20 


Covariance = degree of linear relationship 
between data/outcomes 


2200 
Can knowledge of one sant L= 76.11(T-30) +1222.3 


° 
random process help us say R? = 0.784 


® 








1800 
something about the value of econ 
? 
another: ann 
7 Sea 1200 
ee their covariance is —_ 
high! 30.0 32.0 34.0 36.0 38.0 40.0 


One way of checking linear relationship (“covariance”) is to plot 
the two variables against each other. 
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Covariance = degree of linear relationship 
between data/outcomes 


Ea Abdallah’s Marks Faisal’s Marks 


Quiz 1 4 4 
Quiz 2 8 7 
Quiz 3 2 1 
Quiz 4 4 5 
Quiz 5 1 0 
Quiz 6 9 10 
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Covariance = degree of linear relationship 
between data/outcomes 


Abdallah gets high marks 
When Abdallah eels high even when Faisal gets low 
marks, so does Faisal — marks — no linear relation 
high linear relation 


Faisal’s Marks 
Faisal’s Marks 








Abdallah’s Marks Abdallah’s Marks 
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Covariance = degree of linear relationship 
between data/outcomes 


Abdallah gets high marks 
even when Faisal’s marks ? 
are low — no linear 
relation 


Faisal’s Marks 
Faisal’s Marks 


Abdallah’s Marks Abdallah’s Marks 
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Covariance = degree of linear relationship 
between data/outcomes 


¢ Covariance helps us understand if two random processes are 
Statistically related or not 
¢ Statistically independent processes have zero covariance 


¢ We usually normalize covariance so that it lies between -1 and 1 
¢ Normalized covariance is called “Correlation” 
¢ Noise in communications is mostly assumed to be independent of the 
message signal (i.e., we often assume zero correlation between signal 
and noise) 


How do we write 


Covariance of two 
random variables X and Y 


Independent random variables 
have zero covariance 


For a random process we use the 
autocovariance function 


“covariance” mathematically ? 


C(X4,Y)= E[(X-E[X])(Y-E[Y])] 
= E[XY]- fyby 


C(X,Y) = 0 


Cyx(ty, to) = ELA) — Bx) A) ~ Hx) 


a Covariance between two 


samples of random process X(t) 
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Example 


¢ Rolling two dice at the same time 
¢ Rolling a die five times 


Our friends in an uncertain world! 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


= 2. If this does not change over time then the 
Probability distribution random process is strictly stationary 


v 


Mean. Variance, Covariance <—— If these do not “vary” over time then the 
random process is weakly stationary 
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Mean and Autocovariance of a Weakly 
Stationary Process 


The mean of a weakly [ly(t) — fly for ql t 


stationary process does 
not change with time 


Cyy (to — t+) for all ly and [5 


The autocovariance function of 
a weakly stationary process 


depends only on the time or 
difference between the samples 
and NOT on their actual values _— 
Cyx (T) TH lg -ty 
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Example 


¢ Some functions that satisfy second condition 
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Back to Gaussian Distribution ... 


¢ With the intuitive knowledge of distribution, mean, variance, and covariance we are now ready to 
take a closer look at the very special, common, and useful distribution — the Gaussian 
Distribution. 


H=0 
[=0 
[=0 
H= 


] 
N ~ ~ 7 


exp| =) 





fy(X) = 





Tl O 2? e 
variance 
-5 -4 -3 -2 -1 0 1 2 3 4 5 
X 
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Some Practice Problems ... 


Consider a discrete r.v. X whose pmf is given by 


i 
Ss x=-— i Q, l 
Pxlx) = ‘3 otherwise 
(a) Plot p,{x) and find the mean and variance of X. 
(b) Repeat (a) if the pmf is given by 


ie 5 x = —2,0,2 
Px 0 otherwise 
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Some Practice Problems ... 


(a) 


By = E(X) = 4(-14+0+4 1) =0 


Gl) = var(xX) = E[(X — px)?) = E(X?) = $[(—1)? + (0)? + ()"] = 3 
by = E(X) = 4{-24+04 2) =0 


oy? = Var(X) = $[(—2)? + (0)? + (2)7] = 4 
Pydx) px) 
j 3 
-2 -) ® | 2 x 2 | 0 ] 2 x 
(a) 
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Some Practice Problems ... 


A continuous-time random process is given as X(t) = A+ Bt, where A and B are independent random variables 
uniformly distributed in the interval [—1, 1]. Find: 


(a) The mean function mz(t) 
(b) The covariance function r,(s, t) 


(c) Is X(t) wide-sense stationary (WSS)? 
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Some Practice Problems ... 


(a) Since A and B are uniformly distributed over the interval [—1,1], it is easy to see that they are both 
zero-mean, i.e., E[A] = E{[B] = 0. With that, we get 


m,(t) = E[A + Bt] = E[A] + E[B]t =0 


C[X(s), X(t)] = C[A + Bs, A + Bt] 
V [A] + tC[A, B] + sC[A, B) + stV[B] 


rz(s,t) 


Since A and B are independent, we have C/A, B] = 0. Furthermore 


1? 1 
vi4]=ViB) = | —dr = — 
i)=ViB]= | Sar=5 


(c) The process is not WSS as the covariance function does not depend only on the lag s — ft. 
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Questions??? Thoughts? ? 


° 


e 
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Some familiar terms ... 


¢ Probability 

* Gaussian Noise 

¢ Fourier Transform <a 
¢ Power Spectrum 

¢ White Noise 
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We saw ina previous lecture that ... 


¢ In Fourier Transform, we want to look at signals in terms of a fixed set 
of ingredients 
¢ Ingredients : Sinusoids of different frequencies 


Ingredient Amount 
(sinusoid aaa — 
+ Add all 
waen = i 7 
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Fourier Transform 


¢ How is this shown after Fourier transform? 





Scaling 
Ingredient Amount 
+ (sinusoid frequency) — 
5 Hz Add all 
10 Hz 0.5 
+ 15 Hz 0.25 2 
0.25 


5 10 15 
Frequency (Hz) 
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Fourier Transform 


¢ How is this shown after Fourier transform? 


Amplitude 


Time 





EE 322 


Fourier Transform 


Inverse 
Fourier Transform 


22 - Digital Communications / Dr. Naveed R. Butt @ 


Scaling 


0.5 
0.25 


5 10 15 
Frequency (Hz) 


(mA) | fl inivarcityv 
@ Jour University 


How do we write the Fourier Transform 
mathematically ? 


G(f) = | e(t)exp(—j2nft)dr 


g(t) = | G(fyexp(j2nft)df ——— Shows g(t) written as a “sum 
00 (integral) of complex sinusoids 


J’! = cos(wt) + j sin(wt) 
= & 3 
G(f) Lg(t)] cos(wt) = 7 (e7* ¥ e Jt) 
g(t) =F [G(f)] sinwt) = 2 (et e794) 
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How do we write the Fourier Transform 
mathematically ? 


X(ei”) = ~. a[nje—Ie" 


mi—-— co 


1 oe: is 
x\n| = — X (e7” jet" dw 
27 27 


Fourier Transform of discrete time process x[n] 
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Why complex sinusoids? 


¢ Mathematically easier to work with (e.g., product) 


Visualizing Complex Sinusoids 





Imaginary 


J’! = cos(wt) + jsin(wt) 


Amplitude— 


i ao 9 /ent 





. = Sin(2nf, fh 






Wan -- -- -L7--------} -----54------ 


= : 
\ 0 ge a 
cos(2af,f) 
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Some Fourier Transforms (Visual) 


Not changing 
(frequency = O) 


sin(wt) = X (el! — eI") 4 
constant 
MN\ he ——— _ 
“ 1/T 


Sin wave < t t > < t 








6(s) 
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Some Fourier Transforms (Visual) 


DC 
_—— |. 
t f 0 N-1 0 
0 N-1 0 


t Lo. 
t f 
0 N-1 0 
0 N-1 0 


As frequencies increase, the FT peaks move outwards 
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Some Fourier Transforms (Visual) 


| constant | 5(s) 


MWh = 
- V/T 


in wave 
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(a) 


(bh) 


“Damping” causes “spread” 


Some Fourier Transforms (Visual) 


x(t) 
‘ 
0 
of 


0 4 2 t [s] 





Ix(t)| 


Sharp changes (edges) 
require a lot of frequencies 


0 5 10 15 20 25 30 f [Hz] 
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Some Fourier Transforms (Visual) 


"time" domain frequency domain 


— 





_ ~ 
0 L 


Sharp changes (edges) 
require a lot of frequencies ... and an extremely sharp change 
(delta) requires ALL the frequencies!! 


Impulse, or "delta" function 
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Some familiar terms ... 


¢ Probability 

* Gaussian Noise 

¢ Fourier Transform 

¢ Power Spectrum = 
¢ White Noise 
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Our friends in an uncertain world! 


“ey, ‘ 
% 
‘S 
heey 
We 


¢ Random or uncertain events may still have some underlying 
characteristics that are “fixed” 


¢ Some of these can be 


= 2. . If this does not change over time then the 
Probability distribution random process is strictly stationary 


v 


Mean. Variance, Covariance <——— If these do not “vary” over time then the 
random process is weakly stationary 
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Autocovariance and Autocorrelation of a weakly 
stationary process 


Autocovariance Cyy (tT) =E[(X(t ae T) - Lx) (X(t) Ly ) | 


function 
Oa Covariance between two 


samples of random process X(t) 
Only a minor difference 
between the two. 


Conceptually very similar. Correlation between two 


a samples of random process X(t) 


Autocorrelation Ryy (tT) =E[X(t + T)X (t)] 


function 
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Frequency content of a random process 


e We’ve seen that 
¢ Fourier Transform can be used to see the 
“frequency content” of a signal 
¢ But what if the signal is random? 


¢ Problem: frequency content may change 
from one realization to another! 





_——* X(t) = Acos(wt + @). 


A and @ random variables 
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Autocorrelation Function to the rescue!! 


¢ We've seen that 
¢ Fourier Transform can be used to see the “frequency content” of a signal 


But what if the signal is random? 
¢ Problem: frequency content may change from one realization to another! 


¢ Two important observations can help us out 
¢ 1. The autocorrelation function of a weakly stationary process remains “fixed” between 
realizations 
e 2. The autocorrelation function contains the same frequencies as the original signal (with 
“average power” scalings) 


¢ Solution: 
¢ For a random process it is better to take the Fourier Transform of the covariance function 


For a random process it is better to take the Fourier 
Transform of the autocorrelation function!! 


¢ Power Spectrum = Fourier Transform of the autocorrelation function 


¢ Mathematically speaking ... 
Syy(f) = | Ry xf T) exp(—j2af7r) dz 


CO 


Ryx(™) = | Syx (A) exp(i2afr) df 
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Calculating the autocorrelation function 


¢ For a weakly stationary process X(t) 


Ryy(t) = E[X(t+ 7)X(t)] 


L§ $$ > 


[ 








X(t) X(t+T) 
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Calculating the autocorrelation function 


¢ Three important properties of the autocorrelation function 











Ry (0) = E[X*(t)] ta) = et) Ryx(7)] < Ryy(0) 
It can be used to calculate eieeonimnetite Spntnetnele coud! 


power of the signal 
the average power 
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Some familiar terms ... 


¢ Probability 

* Gaussian Noise 

¢ Fourier Transform 
¢ Power Spectrum 
¢ White Noise a 
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White Noise 


¢ A (stationary) process so random that there is no correlation between 
any two samples! 


¢ The samples can follow any distribution (uniform, Gaussian, Poisson etc.), the 
only condition is that they should have no correlation 

¢ A white noise process that is characterized by the Gaussian distribution is 
called White Gaussian Noise 


¢ White Noise is a good approximation of combined effect of many unrelated noise 
sources 


¢ Noise in communication channels is mostly modeled as Additive White Gaussian Noise 
(AWGN) 


White Noise 


¢ White Noise is a good approximation of combined effect of many unrelated noise 
sources 


¢ Noise in communication channels is mostly modeled as Additive White Gaussian Noise 
(AWGN) 


Channel 





Transmitted +) Received 
signal i r(t) = s,(t) + n(t) 


Smt t) 


Noise 
n(t) 
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White Noise 


¢ Why “white”? 


¢ A white noise process has equal contribution from ail the frequencies (just 
like white light has equal contribution from all the visible frequencies) 





0 


Time description: No correlation 
between any two samples 
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Sw(f) 





Frequency description: equal 
contribution from all frequencies 
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Questions??? Thoughts? ? 


° 


e 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 





FE 322 
Digital Communications 


with 
Dr. Naveed R. Butt 
@ 


Jouf University 


In the last lecture, we saw that... 
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How do we write the Fourier Transform 
mathematically ? 


G(f) = | e(t)exp(—j2nft)dr 


g(t) = | G(fyexp(j2nft)df ——— Shows g(t) written as a “sum 
00 (integral) of complex sinusoids 


J’! = cos(wt) + j sin(wt) 
= & 3 
G(f) Lg(t)] cos(wt) = 7 (e7* ¥ e Jt) 
g(t) =F [G(f)] sinwt) = 2 (et e794) 
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How do we write the Fourier Transform 
mathematically ? 


X(ei”) = ~. a[nje—Ie" 


mi—-— co 


1 oe: is 
x\n| = — X (e7” jet" dw 
27 27 


Fourier Transform of discrete time process x[n] 
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Some Fourier Transforms (Visual) 


DC 
_—— |. 
t f 0 N-1 0 
0 N-1 0 


t Lo. 
t f 
0 N-1 0 
0 N-1 0 


As frequencies increase, the FT peaks move outwards 
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Some Fourier Transforms (Visual) 


| constant | 5(s) 


MWh = 
- V/T 


in wave 





(a) 


(b} A 


“Damping” causes “spread” 
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Some Fourier Transforms (Visual) 


x(t) 
‘ 
0 
of 


0 4 2 t [s] 





Ix(t)| 


Sharp changes (edges) 
require a lot of frequencies 


0 5 10 15 20 25 30 f [Hz] 
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Some Fourier Transforms (Visual) 


"time" domain frequency domain 


— 





_ ~ 
0 L 


Sharp changes (edges) 
require a lot of frequencies ... and an extremely sharp change 
(delta) requires ALL the frequencies!! 


Impulse, or "delta" function 
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For a random process it is better to take the Fourier 
Transform of the autocorrelation function!! 


¢ Power Spectrum = Fourier Transform of the autocorrelation function 


¢ Mathematically speaking ... 
Syy(f) = | Ry xf T) exp(—j2af7r) dz 


CO 


Ryx(™) = | Syx (A) exp(i2afr) df 
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Calculating the autocorrelation function 


¢ For a weakly stationary process X(t) 


Ryy(t) = E[X(t+ 7)X(t)] 


L§ $$ > 


[ 








X(t) X(t+T) 
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Three important properties of the 
autocorrelation function 











oa De ~. — D fy s| ee nm 
Ryy(0) = E[X'(t)] Ryy(t) = Ryy(-7) Ry x 7)| < Ryy(0) 
It can be used to calculate aie eonineite exaeeieeeah 


power of the signal 
the average power 
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Today we shall see ... 


¢ What are some of the properties of the power spectrum? 
¢ What are some of the common power spectra of signals? 


¢ What happens to power spectrum of a signal as it passes through a 
channel? 


Five Important properties of Power Spectra of 


Stationary Processes 
requencies 








2 wa ’ , ™ + , f® Y _ 
EX (D] = [| Syy(A af Syy(S) = Syy() Syx(f) 2 0 
—hD 
(Recall R,,(0) = ELX*(1)]) 
Total area under the power Power Spectra of real processes are ce esiwaenenmedtwe 
spectrum represents the always symmetric (can be non- 
power of the signal symmetric for complex processes) 
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Five Important properties of Power Spectra of 


Stationary Processes 
requencies 


Syx(f) 


Syy(0) = [ Ryy(T) dr 











The DC component of a Power Spectrum 
represents the total area under the 
autocorrelation function 


There is no correlation between 
the frequency components of a 
Power Spectrum 
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Some common power spectra of signals 


-B B f 





Lowpass or Baseband signals 


have all their power in very low Bandpass signals have power in 
frequencies (around zero) bands of high frequencies (away 
from zero) 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Some common power spectra of signals 





: f,/2 
i 
1 
( 
a 
LL 
oO 
ns 
® 
Oo 
s 
2 Baseband Band-Pass Wideband 
< 
0 100 1000+ 
Frequency (MHz) 
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What happens to a signal as it passes through 
a systems 


¢ We shall only consider a special type of systems called LTI (linear 
time-invariant systems). 


¢ We shall only consider weakly stationary signals. 


Excitation Linear system: Response 
h(t) , 
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What happens to a signal as it passes through 
a systems 


¢ An LTI system is fully characterized by its Impulse Response (IR) 


¢ IR = what output the system gives when the input is an impulse (a theoretical 
sharp pulse) 


| 
——>» Channel ——> h(t) 
— 
Impulse Impulse response 
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What happens to a signal as it passes through 
a systems 


¢ If we know the impulse response of an LTI system we can find its 
output to any signal by using convolution 


co 


y(t) = | h(t)x(t— a) dt 
—oco 
Excitation Linear system: Response 
i ———> impulse response —$> >) 


h(t) 
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What happens to a signal as it passes through 
a systems 


¢ LTI system can also be fully characterized by its Transfer Function (TF) 
¢ TF = Fourier Transform of Impulse Response 


¢ TF = what the system does to different frequencies of the signal (e.g., blocks, 
allows unchanged, amplifies, attenuates) 


. Transfer Function output Frequencies 
Input Frequencies 


Amplified 


VAN AN A os adore ee 

















fl ffs fa fe fe hh fo fs fats fe fh fa fs fa fs fre 
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What happens to a signal as it passes through 
a systems 


¢ If we know the Transfer Function of an LTI system we can find what it 
does to the frequencies of a deterministic signal by using simple 
multiplication in frequency domain 


YP) = AP)XGD) 


LT! System 


Input signal Output signal 


Y(f)=X(F)H(F) 
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What happens to a signal as it passes through 
a systems 


¢ If we know the Transfer Function of an LTI system we can find what it 
does to the power spectrum of weakly stationary random signal by 


? . 
Syyxf) = IACI Sy) IAP = HPH*(f) 
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Low-Pass and Band-Pass Channels 


|H(f)| 









lH(f)| 






lH(f.)| 


|H(0)| 


lA(f| 
V2 


|H(0)| 


V2 
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Questions??? Thoughts? ? 


° 


e 
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Modulation : message on a carrier 


¢ Modulation is the process of placing the message on a carrier so that 
it can be carried (transmitted) to the intended receiver 
¢ Message = the actual information we want to send 
¢ Carrier = some signal/symbol which can represent and carry the information 





Demodulation 


¢ Demodulation is the opposite of modulation, i.e., extracting the 
message from the carrier 


What are some of the properties a carrier should have? 
ee 
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What are some of the properties a carrier 
should have ? 


¢ It should be able to load (or represent) the information somehow 


¢ It should be able to carry the message along the desired path and 
distance (and should be better at it than the message itself) 


¢ It should be able to handle the amount of information in the message 


¢ There should be a way for the receiver to take (extract) the 
information from it somehow 


¢ And a “good” carrier should provide high-quality and efficient service 
(low-cost, low-power, fast, reliable, safe etc.) 


Common Carriers: Waves and Pulses 


¢ A sinusoidal wave can carry information 
¢ How? Coming up! 


¢ A train of pulses can carry information 
¢ How? Coming up! 


At 


oC? 


JUL ULL, 


Period 7 = 2At 
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Waves: Amplitude, Frequency, and Phase 


¢ Consider a sinusoidal wave 
¢ Acos(2nft + ~) 


¢ What can you “tune” here to change the wave? 
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Waves: Amplitude, Frequency, and Phase 


¢ Consider a sinusoidal wave 
° Acos(21nft + >) 


¢ What can you “tune” here to change the wave? 
¢ You could play with its amplitude (A) 
¢ You could play with its frequency (/) 
¢ You could play with its phase (¢) 
¢ Or, you could play with any two or all of the above at the same time 


¢ Note: all of the above “changes” can represent information!! 
° e.g., high frequency = 1, low frequency = 0 etc. 


Pulses: Amplitude, Position, Width, and Pattern 


At 
¢ Consider a train of pulses — 
¢ What can you “tune” here? TULLE, 


Period 7 = 2At 


, Time ,———> 


010101110111110101010 








Loo 
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Pulses: Amplitude, Position, Width, and 
Pattern 


¢ Consider a train of pulses 
¢ What can you “tune” here? 

¢ You could play with the amplitudes of the pulses 

¢ You could play with the positions of the pulses 

¢ You could play with the widths of the pulses 

° Or, you could “encode” information in some special patterns of the pulses 
¢ Note: all of the above “changes” can represent information!! 

° e.g., pulse = 1, no pulse = 0 


Message Types: Analog and Digital 


We saw that both waves and pulses can be used to carry information (messages) 
Next, we see the two common forms a message takes 
Message in analog form 


Message in digital form 


Message Types: Analog and Digital 


Voltage 


Cm \ Input Modulating Signal 


Carrier Frequency 


NN vm AM Signal 


FM Signal 


PM Signal 
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Voltage 





Input Modulating 
Digital Signal 


Carrier Frequency 


WM to loo 
ASK Signal 


FSK Signal 


PSK Signal 


—_ 


12 


Message Analog Message Analog 


Pulse Position Modulation 


Pulses 
Waves —= 


Message Digital (or Digitized) Message Digital (or Digitized) 


Pulse Code Modulation 
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Mathematically: the message and the carrier 


¢ We look at a common form of amplitude modulation to identify the 
parts of a modulation/demodulation scheme 


¢ We also look at power spectra of message and modulated signals 


¢ How to demodulate? Two approaches: coherent (multiply by local 
wave and low-pass), non-coherent (simple low-pass: detect envelope) 


¢ Why use coherent then? 


Mathematically: the message and the carrier 


Message signal Modulated signal 
)—————| Modulator s(t) 


Carrier 
cos(2mf.0) 


S(t) = m(t)cos(2mf,1) 


Message 


mit) 


time (seconds) 


Carrier 
1 
= 
° ‘VWI 
4 | 
0 5 10 15 20 25 30 


time (seconds) 


DSB-SC waveform 


o 
an 


mi(t).c(t) 


10 20 25 30 


1 
time (seconds) 
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Mathematically: the message and the carrier 


i smo $(t) = m(t)cos(2nf,1) 
{care 
cos(21f..0) 


S(f) 
M(f) 


M(0) 





fc te res Upper sideband 
we Ppp 


Ww. O0. Ww f F-W f f+W 0 &-W f f+W 
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Coherent Demodulation 


¢ Multiply the received signal with a locally generated carrier which is 
(ideally) synchronized with the carrier used by the modulator. 


¢ Pass the resulting signal through a lowpass filter to extract the 
message. 


wpass 


rio ve Oe FE] r(t) NAS 
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Mathematically: Coherent Demodulation 


Assuming noise-free transmission, received signal is 
y(t) = s(t) = m(t)cos(27f,t) 
Multiplication with locally generated carrier results in 
y(t) cos(27f.t) = m(t) cos*(27f,t) = =m(t) + =cos(4rft) 
Passing through a lowpass filter gets rid of the second term, leaving us with the message at the receiver 


r(t) = m(t) 


Non-Coherent Demodulation 


¢ In non-coherent demodulation we do not generate a local version of 
the carrier and use an envelope detector instead to extract the slowly 


varying “envelope” of the signal. 


ste i}, if 
intl) han : RC a 
jt ‘|? Recovered 


1 
AM Signal | Message 


fe » fia 
“oi Am fT f> teen 
et Bee EL eds 


Note: this works under the 
Rectified AM Si l ; , , 
peree — assumption that the signal is not 


over-modulated. 
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Non-Coherent Demodulation 


¢ In non-coherent demodulation we do not generate a local version of 
the carrier and use an envelope detector instead to extract the slowly 
varying “envelope” of the signal. 


Output, m {t} 
Input, S ‘ 
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Pulse Code Modulation (PCM) 


¢ In PCM we take an analog signal (message) and transmit it in form of 
digital pulses. 


Analog Signal 







PAM Signal 


Ornwse VF Oun eo 


Quantized Signal 


Digital Data 


| 


, Time, 





010101110111110101010 7 


Binary stream coded into pulses using a Line Code 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 





22 


Sampling, 








Message In Quantization 
analog form and Coding 
Time 

Digitized , P 

message n 0 

(sampled and a d 

quantized) a : 
ooo YY 

Message ow 

Sanvencd ee 010101110111110101010 

binary stream 

Binary stream 

converted to pulses Time EE 
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Pulse Code Modulation (PCM) 


¢ In PCM we take an analog signal (message) and transmit it in form of 
digital pulses. 


¢ Steps involved are 
¢ Sampling: convert analog signal to discrete signal 
¢ Quantization: quantize the collected samples to fixed levels 


¢ Encoding: represent the quantized samples in binary 
¢ Line Codes: choose how Os and 1s will be represented in pulses 


PCM Transmitter 





PCM Receiver 
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How to Represent Os and 1s? Line Codes 


¢ PCM (and its variants) need to represent Os and 1s electrically for 
transmission of binary streams 


¢ The schemes used for representing Os and 1s are called Line Codes 


¢ Five types of Line Codes are commonly used 
¢ Unipolar NRZ 
¢ Polar NRZ 
¢ Unipolar RZ 
¢ Bipolar RZ 
¢ Manchester 


Terminology: NRZ vs RZ, Unipolar vs Polar 


¢ Nonreturn-to-Zero (NRZ) 
¢ Class of Line Codes where the pulse level does not return to (and stay at) zero level 
during one symbol (bit) 
¢ Return-to-Zero (RZ) 
¢ Class of Line Codes where the pulse level returns to (and stays at) zero level for some 
time during one symbol (bit) 
¢ Unipolar 


¢ Class of Line Codes which use only one polarity for pulse amplitude (e.g., 0 or +10, 
but not negative) 


¢ Polar 


¢ Class of Line Codes which both positive and negative polarities for the pulse 
amplitude (e.g., +10 and -10) 


1. Unipolar NonReturn-to-Zero (NRZ) 


Delta function 
of weight 1/2 


Binary data O 1 1 0 1 0 0 1 






Power 
Spectrum 





Advantages: 

- Simple 

Disadvantages: 

- Transmits DC level as well (waste of power) 
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2. Polar NonReturn-to-Zero (NRZ) 


Binary data O 1 1 0 1 0 0 1 


A Power 
Sy ol =101H a0] a8) 
0 
—A 





Advantages: 
- Simple 





Disadvantages: 
- Large power near DC (waste of power) 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 39 


3. Unipolar Return-to-Zero (RZ) ss 


Delta function 





Binary data O 1 1 0 1 0 Oo 1 aie of weight 1 
Power . 
Spectrum 
0 Delta function 


of weight 0.1 





Advantages: 
- Delta functions in power spectrum which can be 
used for bit-timing recovery at receiver 





Disadvantages: 
- Delta functions consume power 
cM > 
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4. Bipolar Return-to-Zero (RZ) 





Binary data O 1 1 0 1 0 0 1 


Power 
A Spectrum 
0 
—-A 


Advantages: 
- No DC (saves power) 


Disadvantages: 
- Low frequencies disappear only if 1s and Os appear 
with roughly equal probability 
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5. Manchester Code 


Binary data O 1 1 0 1 0 0 1 


Power 
A Spectrum 
0 
—A 


Advantages: 
- No DCor low frequencies regardless of the 
Statistics of occurrence of Os and 1s 








cM > 
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Questions??? Thoughts? ? 


° 


e 
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@ 
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Analog > Digital 


¢ Most processes in real life are analog. 
¢ Analog = continuous in time and continuous in magnitude 
¢ Continuous? No breaks. Can take any value in a given range. 
° e.g., temperature in this room 


Classroom Temperature 





we 
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Classroom Temperature 
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Analog > Digital 


¢ Most processes in real life are analog. 
¢ Analog = continuous in time and continuous in magnitude 
¢ Continuous? No breaks. Can take any value in a given range. 
° e.g., temperature in this room 


Continuous in amplitude 
(e.g., can take any value 
in shown range) 





Continuous in time (e.g., can take any value in shown range) 
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Analog > Digital 


¢ Digital Communications works with digital signals 
¢ Digital = discontinuous in time and “discontinuous” in magnitude 


5 
6 
5 “discontinuous” in 
: amplitude (e.g., can not 
2 take values between 3 
: and 4, like 3.5 etc.) 
=4 
aD 
3] 
discontinuous in time = 
(e.g., values taken only at 6 
fixed times but not in- = 


between) 
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Analog > Digital 


¢ Where do digital signals come from? 
¢ In most cases, we take analog signals and convert them into digital ones! 


° e.g., Measure room’s temperature every two seconds (0, 2, 4, 6...) , and round off 
measurements to fixed values (0, 1, 2, 3, 4...) 


OrRPNWHBOON 


1 
a, 
23 
-4 
5 
6 
<7 
-8 
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Analog > Digital 


¢ Converting analog signals to digital is a two step process 
¢ Step 1: record signal only at fixed time intervals (called Sampling) 
¢ Step 2: “round-off” recorded samples to fixed set of values (called 





Quantization) 
From Time Continuous to Time Discrete 
/\J\ SAMPLER QUANTIZER | | | | 
ANALOG TO DIGITAL CONVERTER 
Continuous time/ Discrete time/ 
Continuous amplitude Discrete amplitude 
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Sampling & Quantization 






ig ii i? 3 


Quantization levels 
So — Bo to SS 1h om 4 
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Sampling & Quantization 


1.00 

0 7/5 

050 

0.25 | h 

, I vie pe a 

026 > T , ; T 3 Ti 
~0.50 

O76 

1 (al , iD) ic) 
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Good Sampling & Quantization 

















<— Sample Rate —> Higher... 

t ci H PPR EE ete 
* : - 
a : 

i _ 

ay 

aT 

oO || 
bl 

| m 
| 
y 









Almost 
No 
Error... 
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Analog > Digital : Important Requirement 


¢ The information content of the signal should not change! 
¢ (or change as little as possible) 
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Q. How many samples are enough? 


¢ When we sample a signal, we want the sampled signal to have the 
same information content (e.g., frequencies) as the original analog 
signal 


¢ Then how many samples are enough to make sure of this? 


Student sit-ups!! 


Imagine a bored student starts doing sit-ups in the class. Let’s 
say he takes two seconds to complete each sit-up. If | look back 
from the board every two seconds, what may | see? 


standing 


sitting 





y = times | look back from the board 
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standing 


Reality 





sitting 


Saceodeeedtecuesancnanan i  )mmmnlgenbammmes ~~~ -- ~~ -- ------- === sta nd ng 
What | see 


ss ____________» sitting 


- always find the student in one position (e.g., standing) 

- Ahigh frequency event appears to me as a low frequency event 
(zero frequency in this case) 

- Inorder to “catch” the student in different positions | should look 
back perhaps twice in two seconds!! 
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Aliasing = when a high frequency looks like a 
low frequency due to insufficient sampling 


¢ In the sit-ups example, the high frequency appeared to me as a low 
(zero) frequency because of insufficient (too slow) sampling. 


A 
: IN (| i 
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Q. How many samples are enough? 


¢ Student sit-ups example 


¢ We see from the example that insufficient sampling can change the 
information in the signal 


¢ Also, it seems that sampling at least twice the signal frequency can help 


e “Sample twice the highest signal frequency” is actually an important result in 
signal processing, called Nyquist Rate. 


¢ Next, we derive the Nyquist Rate formally (mathematically) 


How can we write a sampled signal 
mathematically ? 


g(t) 











9 ee 





Measured samples g(nT.) 7 
Unit impulse 
Mathematical | _ . 1 t=ntT 
formulation of the 85(f) = >, g(nT.) (t—nT,) 6(t —nT;) = ‘ pt nT. 
Ss 


measured samples n=—o 
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Information (e.g., frequency) content of a signal 


9(t) G(f) 








gs) = YS gaTat-nT) GAN = LOM +h Y CU-mf, 


n=-*4 m= —0 


m#0O0 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 





Ideally we want: Gs(f) = G(f) 


i.e., we want frequency content of sampled signal to be the same as that of the original signal 


Gif) =fGNt+h > Gf-mfy) 


m = —oco 
mz#O0 \ 
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For a “bandlimited” signal ... 


¢ Let us consider a bandlimited signal with frequency content shown 
below 
¢ The signal has bandwidth 2W and satisfies G(f) =0 for | f|> W. 


G(f) \ 
7 ee 


—W 0 W 
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G(f) 


G(0) 





Copies (called Replicas) of the 


Original signal spectrum original signal soectrum centered 


\ Alte fect 2 fey wis 


GAN) =fGN+h Y Gf-mf,) 


m= —@ 
mz#0 
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Replicas and Aliases ... 





—2f; —fs “Ww oO WwW fe vA 












moe -f; W 0 Wf 2 fe 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Nyquist Rate 






fe <2W 





oh -f; W 0 wf DF 





—2f, -f, —-W 0 wf, 2fs 








2W 
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SO, 


¢ If the signal is bandlimited and sampling frequency is set to at least 
twice the highest frequency of the signal then we can easily recover 
the original signal from the sampled signal 


: | 
=> Gi) = 7G, 9 -W<f<W 


1. Gif) =0 for|f| >= W. 
2. f= 2W 
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And how do we get rid of the replicas ? 


ae 







Note: not possible 
if f6 < 2W 


low-pass filter 
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And what if the signal is not bandlimited? 


¢ Most signals of interest are bandlimited 
° e.g., human voice 
¢ We can mostly define a range of frequencies we are interested in and 
remove the higher ones before sampling 
¢ This process is done through an Anti-aliasing Filter 


X(a) w; < 2B => 
G(w) 


@ 
-B -w./2 w./2 B -B -w./2 w/2 B 


¥(w)=X(@)G(w) 
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Analog > Digital > Analog 


antialias filter 





Digital 


Processing 
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reconstruction filter 


29 


What aliasing looks like 
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Sampling Summary 


¢ Sampling Theorem 
¢ A bandlimited signal with no frequency above W can be fully recovered from 
its samples if sampled at 2W (or faster) 


¢ A bandlimited signal with no frequency above W is fully described by its 
samples if sampled at 2W (or faster) 


¢ Ensuring correct sampling and reconstruction 
¢ Apply anti-aliasing filter before sampling 
¢ To avoid aliasing 


¢ Apply low-pass filter for reconstruction 
¢ To get rid of replicas in reconstructed signal 


Quantization and Quantization Noise 


Quantization levels 
a —~ BI 0 & hm oo 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Uniform Quantizer 


Input 
level 





Input-output graph of a uniform quantizer 
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Signal Range, Number of Quantization Levels 
(L) and Step-Size (A) 


10V 
Signal Range = 2M pax 
(Mmax = 10 V) ae quantization levels) 


-10V 


2M wax 
Step-Size A = = 
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Quantization Noise 


1 Input wave 


2 Quantized output 


Magnitude 


Quantization Noise (Q) 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 





& 
3 
os oe 
So [TZ 
o HUASAAAAA Z IN AAAAAARAR IN AI AAMAA A AZ 
esVVVVVVV NO NVVWWWYY MN VV VIWVV VV OY 
ss ; 
— Time—~- 
a 


35 


Quantization and Quantization Noise 


¢ Just like sampling, we do not want quantization to affect the 
information content of the signal 


¢ Unfortunately, that is not always possible 
¢ Quantization introduces some amount of error in the signal called 
Quantization error or Quantization Noise 
¢ We can try to keep the error/noise as low as possible 
¢ For that we must first study the properties of the quantization noise 


Statistical Properties of Quantization Noise 


¢ Assumptions/Definitions 
¢ Uniform Quantization (quantization levels are equally spaced) 
¢ Number of quantization levels = L 
° Original signal amplitude lies in the range [—™Myngx, Mmax| 
¢ Quantization Noise Q = amplitude difference between original and quantized 
signal 
¢ With the above assumptions/definitions, we describe distribution, 
mean, and variance of the quantization noise Q 


Distribution of Quantization Noise Q 





| 
IoD =) w& 
0 


quantization step-size 
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Mean of Quantization Noise Q 


| A 2m 
. 4 a —— max 
foM =) kX 2 2 z 
Q, otherwise 
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Variance of Quantization Noise Q 





I _A <aqa< A 2M max 
fog) =} A’ °2~7"2 =e 
0 otherwise 
oe = E[Q ] 
A/2 
= J i! fol) dq 
LY 
d so 
- if" a q r 
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Q. How to reduce quantization noise? 
A. Increase L (number of quantization levels) 


E[Q"] = 7 


XY 
_ <I max ax 
o seems 





or is 


Q. 
A. 


How to reduce quantization noise? 
Increase L (number of quantization levels) 





3-bit (L = 8) quantization. 
Lower quantization noise. 


2-bit (L = 4) quantization. 
High quantization noise. 
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Again, Good Sampling & Quantization 


<— Sample Rate —> 





nnn 


<— BitDepth — 
TE | ed | 





Almost 
No 
Error... 
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Questions??? Thoughts? ? 


° 


e 
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Jouf University 


Signals in Noise 


¢ Consider a transmission systems sending circles and triangles (two 
symbols agreed between sender and receiver) 


¢ If there is no noise or distortion, receiver should be easily able to tell 
what was sent 


AOOAA => AOOAA 
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Signals in Noise 


¢ If there is noise or distortion, the receiver has to guess (estimate), 
whether the sent symbol was a circle or a triangle 


Guess (estimate) 


O/C am we | Aw® 
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Signals in Noise 


¢ When you guess (estimate), there is a chance (probability) of making 
a mistake (error) 


Probability of Error 
Actually Sent Estimate (what receiver 
thinks was sent) P, = P(guess /\ | sent (.)) + P(guess (.)| sent /\ ) 


A ree 
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Signals in Noise 


¢ Let’s make the situation more interesting. 
¢ Suppose sender informs that he will send circle 80% of the time 
¢ Then it should be more important to avoid the error: 


P(guess triangle | sent circle) 


P(C)) =0.8 


Already known (prior) probabilities 
P(/A\) =0.2 of sending circles and triangles 





Probability of Error 


P, = P(C))P(guess /\ | sent .)) + P(A )P(guess ()| sent /\) 
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Let’s talk about the choice of Symbols 


¢ Our choice of symbols clearly affects the probability of error P, 


¢ For instance, we have seen previously the following example 


Channel 





Probability of 

guessing “ta”, OD (4 | 4;) — High!! 
when actually 
“Za” is sent 
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P (4|¢) =Low!! 


Let’s talk about the choice of Symbols 


¢ Back to circles and triangles 


¢ Suppose you receive an octagon. How do you decide if the sent 
symbol was a triangle or circle? 


Guess (estimate) 


cme C 
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Let’s talk about the choice of Symbols 


¢ Back to circles and triangles 


¢ Suppose you receive decagon. How do you decide if the sent symbol 
was a triangle or circle? 


Grey areas = amount of “mismatch” 
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Q. How can we check “similarity” mathematically? 





Inner product = projection of one vector (or signal) on other 


iz Si] Sk] 
s:s a? oe ; _ | 572 — | 2 
j=l | 
SiN SkN 
T 


J si(tsy(t) at 
0 
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Energy and Norm 


The inner product of a signal with itself gives the energy (£;) of the signal 
(and equals the square of the norm) 


T 


9 
E.= | s.(t) dt Signals in continuous-time form 
l l 

0 


9 


N ) 
B= 333 = Is? 
j=! 
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Q. How can we check “similarity” mathematically? 











na 
ei, | ee 
Euclidean Distance = how far apart are the tips of the vectors fe 
5 N : SiN 
— “= Wait ee Signals in vector form 
s;—s,| > Gy -5—) 


j=! 


. 2 s, = | "k2 
s.(f)—s,(t)) dt Signals in continuous-time form wk |, 
[ ()-5,()) d 
0 
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Examples ss 


sis. 


S2 
¢ Consider three vectors 


vie Gb ee Bh o= B . 


¢ We can see that 
* S,and Sz have no projection on each other (as their inner product sts, = 0) 


¢ Thus, they are very “dis-similar” 
° Ss3has projection on both s,and Sz (inner products: sis, = sis, = 3) 
¢ It has more “similarity” with Sz (since the inner product is higher) 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


12 


Back to the choice of Symbols ... 


¢ Suppose you receive small circle 
¢ You can easily guess that it is a scaled version of circle 
Guess (estimate) 


7 = me Z\ o @) 


\or 
a 7 wie 
a /\ Circle and Triangle are a good choice since neither 
one can be created by a simple scaling of the other 
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Orthogonality: “completely dis-similar” 


Circle and Triangle are a good choice since neither one can be created by a 


simple scaling of the other (this makes decision-making easier at the receiver) 





Q. How can we put such “complete dis-similarity” mathematically? 
¢ We saw that “inner product” can be used as a measure of “similarity” 


¢ So if the inner product turns out to be zero we can say that the vectors (or 
signals) are very dis-similar 


¢ Mathematically, we say they are “orthogonal” to each other 
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Orthogonality 





If Inner product = 0 then s; and s; are orthogonal to each other 


N 
=) Sijskj = Signals in vector form 


j=1 


T 
f syns ar =¢ 
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Examples ss 


sis, 


S2 


¢ Consider three vectors 


cae Gb ee Bh o= B . 


¢ As we saw before, s/sz = 0 (zero inner product) 
¢ Thus they are orthogonal to each other (no projection on each other) 


¢ ss3has projection on both s,and Sz (inner products: S484 = 2, S4S> = 3) 
¢ Therefore, it is not orthogonal to either one 
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Finding Distinct Elements — Signal Space 


¢ Let’s make things more interesting ... 
¢ Let’s now consider three signals 


¢ What are the minimum distinct (orthogonal) elements that can 
represent all three? 


Signal A Signal B Signal C 
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Finding Distinct Elements — Signal Space 


¢ What are the minimum distinct (orthogonal) elements that can represent all 
three signals below? 
¢ Clearly, these are: Circle and Triangle 


¢ Such mutually orthogonal (distinct) elements are called “bases” 


Signal A Signal B Signal C 
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Geometric Representation of Signals 


¢ We can “describe” the three signals in terms of two elements (“bases”) 
¢ Signal A = [2 O] (i.e., it has two circles and no triangle) 
¢ Signal B = [0 2] (i.e., it has no circles, and two triangles) 
¢ Signal C = [1 1] (i.e., it has one circle and one triangle) 


¢ We can thus re-write the three signals as vectors 
¢ This is called signal space representation or geometric representation 


Signal A Signal B Signal C 
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Bases, Signal Space, Q R ae 
and Signal Vectors 


Signal A Signal B Signal C 


ee 








Signal C = [1 1] 


= [02] 





Signal B 


Signal A = [2 0] Signals written (or drawn) in vector form using the 
C) bases are called signal vectors (note that all three 
signal vectors lie in the signal space) 
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Putting Bases, Signal Space, and Signal Vectors Mathematically 


normalized to unit energy 


T 2. 
P(t), Py(D), ---5 PND | b(t)G(t) dt = 5; = | te 
0 O if iF) 


N orthonormal basis functions 
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Putting Bases, Signal Space, and Signal Vectors Mathematically 


S| (f). s(t), — sy(t) M signals in continuous-time form (M < N) 


Signals written in terms of the basis functions 


M signals in signal space (vector) form 
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Putting Bases, Signal Space, and Signal Vectors Mathematically 


= 7 dt Si 








(2) Formula for calculating vector values {s;;} 
-1.2 
s(t) (3) Si2 (= 1,2,...,M 
72] LZ, 17 
(rt) 
y(t) 
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Putting Bases, Signal Space, and Signal Vectors Mathematically 


Knowing signal-space values {s;j} and the basis 


functions {¢, (t), ..., dy (t)} we can reconstruct 
the continuous-time signal s;(t) 


, (2) 





A) 
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Example ; : 
S31 3 
Projection of S3 onto @4 


¢ Consider three vectors / 2 
_ [3 _fi _ 72 Projection of S3 onto @2 
$1 = 4 2 BF S3= ee 


¢ Clearly, these three can be represented by the bases 


[eB 


¢ Are these bases orthonormal? 







-3 


- diz =0 
> bio, =1, 362 = 1 
e Yes! 


¢ All three signals can be written as weighted sums of @,and @2,e.g., ~<-> > 77 
+ s3=(2)[0]+2)[]] = 261+ C262 
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Gram-Schmidt Orthogonalization Procedure 


¢ We discussed basis functions (@,(t), ..., dy(t)) for the geometric 
(vector) representation of signals 


¢ Next question is how can we find the basis functions for a given set 
of signals? 


¢ One useful procedure that helps us in this is the Gram-Schmidt 
Orthogonalization Procedure 


Gram-Schmidt Orthogonalization Procedure 








rT , 
1.Given M signals 54 (7), So(t), ---, Sjg(t) with energies E. = | s;(t) dt 

0 
2. Choose one arbitrarily, and 4) = S,(0) 
get the first basis function as P( = E 

| 
84) | 

3. Get the second basis functio 92(7) = .: where 85(1) = S5(t) — S95] Q,(t) 
as | g5(t) dt r 


0 
oo | 
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S5(t) Q(t) dt 
0 


Gram-Schmidt Orthogonalization Procedure 


4. In general, get the i-th basis function as 


, i-| 
g;(1) a 
~;(t) = Po where g(t) = S(t) - » SiO) 
7 -_ 
I) g.(t) dt i= 
0 
r 
(=1,2,..,N (N<M aed we -_ 49 
i ( ) Sij J sg df, j=1,2,...,1-1 
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Other useful relations 


Example 


T 
$1,859 


Isis 


OO 


cos @ = 





| S,(t)85(1) dt 
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Other useful relations 


a - | , 1/27 .2 | , 1/2 
fF ssosgemraq (f° sco af" sata 
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Questions??? Thoughts? ? 


° 


e 
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FE 322 
Digital Communications 


with 
Dr. Naveed R. Butt 
@ 


Jouf University 


AWGN — the simplest channel 


¢ When signals pass through transmission mediums (“channels”), they 
often suffer noise and other distortions (changes) 


¢ We use several different models to represent such channel effects on 


a 
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AWGN — the simplest channel 


¢ The simplest model we have for channel effects is the AWGN model 
¢ A= Additive 





¢ W = White 
¢ G = Gaussian 
e N=Noise 
Transmitted Received 
signal signal 
s;(t) + x(t) 
; <f< 
x(f) = S(T) + w(t), OsrsT 
l = i, a 


White Gaussian noise 
w(t) 
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Revision — what is White Gaussian Noise? 


¢ Noise 
¢ Something unwanted 
¢ White 
¢ A (stationary) process so random that there is no correlation between any 


two samples! 
¢ White Noise is a good approximation of combined effect of many unrelated 


noise sources 
e Gaussian 


¢ A white noise process that is characterized by the Gaussian distribution is 
called White Gaussian Noise 


Autocorrelation and Power Spectral Density (PSD) of a white 
noise process 


¢ A white noise process has equal contribution from al/ the frequencies (just like 
white light has equal contribution from all the visible frequencies) 


Sw(f) 








0 
Time description: No correlation Frequency description: equal 
between any two samples contribution from all frequencies 
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AWGN - mathematically 


Signal-Space (vector) form 
Continuous-time form 
x =S;+ W, 2 ey eee | 
i kos | oe 
X(t) = S(t) +w(t), Ostsl 
I= 1, 2, ; M x4 Wy 
X2 si W2 
xX = S; = 572 w= 
Xy SiN wry 
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Continuous-Time > Signal-Space 





(1), y(t), .... byt) 


N orthonormal basis functions 
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AWGN - Statistically 


Gaussian Zero-Mean, White, Gaussian 


Considered deterministic 
(non-random) 
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Statistical Properties of s; 





Mean Msi = Elsi, =i] 
Since s; is considered 
deterministic (non-random) 


2 _ 
Variance O5,; = Var|si;| = 
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Statistical Properties of W 





eeeen Pi El; -° Ow, = Var|W;| — = 


a, E|W,W,|=0 i#k 
White Rw(t) =} 2 
0, T#O N, 


PSD(W) = > 


1 1 
Gaussian fw ;(w;) = Tag PE Ny” 
No No 


white fee) = fv (ws fired, 
Gaussian 
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Statistical Properties of X 


2 No 
Mean Ux, = E|Xx;| = Sij Variance & Ox, = Var|X;| = os 


Covariance 
Cov|X;X,|=0 i#k 


l | 2 
Gaussian fy (x;|m;) = FS 09 |-5- 0-5) | 
DOr ile: JN Ny) i 4 
0 


Uncorrelated (x| n-) “ Ay | n-) (nN NV /2 1 XN , Ni 
Tx(x|mj) = [ [Fx.Qj]m) = No xn) — ) Gs, 
Gaussian ani j Ji! Ny 2 jG 


m, = symbol represented by signal s; 
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Evaluated based on 
Statistical properties 
of s; and W 


Decoding the Received Signal 


¢ Next, we are interested in finding ways of deciding which symbol was 
sent 


Guess (estimate) 


= am he 
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Decoding the Received Signal 


¢ Assumptions 
¢ Channel: AWGN 
¢ Symbols: m1, Mp, ..., Ny 
¢ Signal used to represent symbol m, (in vector form) : s; 
¢ Received signal vector: kK = s; + W 


¢ Problem statement 


¢ Given observation vector x and the above assumptions, decide (estimate) 
which of the symbols (™m,, Mz, ..., My) was sent!! 


¢ Notation 
¢ We shall denote our estimate (decision) as m 
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Maximum A Posteriori (MAP) Decoder 


MAP Decoder 


Prior probability of transmitting symbol m, , i.e., 


1 = P(my) 
¢ Algorithm 
Conditional probability of seeing x 
; : | 
m Mecosemuneron's ee given/assuming symbol m, was sent 
Tf (X|Mx) 


2. Calculate value of the cost function for each symbol {mz }r=1...M 
3. Decide m = m; if the cost function is maximum at k = i 
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Maximum Likelihood (ML) Decoder 


Special case of MAP Decoder 


When all symbols have equal probability of 
transmission (70, = 1) = ++: = Ty) 


¢ Assumptions for MAP Decoder 
¢ Symbols: m1, Mp, ..., Ny 
¢ Signal used to represent symbol m, (in vector form) : s; 
¢ Received signal vector: K = $s; + W 


¢ Additional Assumption for ML Decoder 
¢ All symbols have equal probability of being transmitted, i.e., 
Hy =z =" = ly 


Background: How do we get to the MAP 
decoder? 


L ke | i h ood F U a ctl O n Probability that observation x was generated by 


symbol m, (i.e., the conditional probability seen 


S/o from the receiver’s point of view) 


l(my) = f (x|mx) 


Log-Likelihood Function In = natural log 


We often find it more convenient to work 


So with the log-likelihood function 


L(m,) = Inf (x|mx) 
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ML Decoder 


¢ Algorithm 


log-likelihood, i.e., L(m,) = In f(x|m;) 


1. The cost function is 


L(m,) 


2. Calculate value of the cost function for each symbol {mz }x=1...M 
3. Decide m = m; if the cost function is maximum at k = i 
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Background: How do we get to the ML 
decoder? 


Region 


Decision Regions 





It is useful to have a graphical interpretation of the maximum likelihood decision rule. 
Let Z denote the N-dimensional space of all possible observation vectors x. We refer to 


this space as the observation space. Because we have assumed that the decision rule must 
say m = m;, where i = 1, 2, ..., M, the total observation space Z is correspondingly 
partitioned into M-decision regions, denoted by Z,, Z>, ..., Zy. 





In short, if vector x lies in region Z;, we decide that the sent symbol was m,; 
(and vice-versa) 
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Decision Regions 







Decision 
boundary 


Message 
point 1 


‘. Decision 
boundary 
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Symbol Region 
Mj; Z i 


Illustrating the partitioning of the 
observation space into decision regions 
for the case when N = 2 and M = 4; it is 
assumed that the M transmitted symbols 
are equally likely. 


23 


ML Rule written in terms of Decision-Regions 





ML Decoder tor AWGN (Formulation 1) 


N 
: 
Observation vector x lies in region Z; if » (X;—S,;) 1s minimum for k = 1. 


j=! 





EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Background: How do we get Formulation 1? 


It can be shown that for AWGN case, the log-likelihood function is (ignoring some constant terms) 


] \ 
L(m,;) — 


fo | 


Clearly, this function is maximized when the summation is minimized!! 
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N 
—_ — — _— 9 
Ny a) Sij) > p= bo 


..M 


ML Decoder for AWGN (Formulation 2) 


Observation vector x lies in region Z. if Euclidean distance |x —s Al 


is minimum for k = 1 
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Background: How do we get Formulation 2? 


We simply note that the summation in Formulation 1 is just the square of the Euclidean 
Distance between the observation vector x and the transmitted signal vector s; 


¥ &y- y= |x—s4f° 


f=] 
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ML Decoder for AWGN (Formulation 3) 


N | 
Observation vector x lies in region Z. if » XSpi— 5£)| is maximim for 


{= 
‘ = 1, where E,is transmitted energy. 
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Background: How do we get Formulation 3? 


We expand the summation of Formulation 2 and note that only the second two 
terms depend on the optimization index k (so the first term can be dropped 
from the optimization) 


N N N 


7 


N 
>. (x; KY i = D x; —2 2 XS Kj - pz i 


j= 7S ga8 j=! 
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How can we use the ML Decoder? 


We saw that all three formulations of the ML decoder require the observation 
vector x. Depending on how we produce x from the time observation x(t), we 
can have different receivers, two of which are Correlation Receiver and 
Matched Filter Receiver. 


Matched Filter? 


Given a pulse signal ¢(t) occupying the interval 0 < ¢t < 7, a linear time-invariant 
filter is said to be matched to the signal @(f) if its impulse response /(f) satisfies 


the condition 





h(t) = @(T-t) forO0<t<T 
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Obtaining x through Matched Filters 


x; = J xoh¢T- t) dt 


Where hj are the “matched” filters: 


h(t) = o(T — t), for O<t<T and j=1,2,...,M 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Background: How do we get the matched 
filter formulation? 


A simple comparison of the correlator output with the output of a an LTI filter, gives the matched filter formulation 


r 
x; =f x(e(t)dt = y(T) = J xh(T-0 dt 





h(t) = $(T-1) 


EE 322 - Digital Communications / Dr. Naveed R. Butt @ Jouf University 


Correlation Receiver vs. 


Correlation 
Receiver 


Matched Filter 


Receiver 


(Golaaali- kom aalsmaaeliViare, 
x(t) dla 4are | Al 1e) 
orthonormal basis 
functions 


Use x in the ML decoder to 
decide which symbol was 
ola 


Pass the received time- 
x(t) signal through a set of 


Use x in the ML decoder to 
decide which symbol was 
matched filters sent 
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=) 


=) 


Matched Filter Receiver 


Correlation Receiver 


Inner-product calculator 











——— — 1 
| a 
(x) Accumulator (2) 
+ 
+ a eee J - 
1 
Ss) 7 Fy 
rs 
(x) Accumulator (=) Select Estimate 
+ 5 largest ps 
1 
i 2 Ep 
a. 
XSi 
oo Accumulator a 
_ 
On(t) 3 
Su 2 Em 
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Correlation Receiver (mathematically) 


x4 
T — 
Step 1: Find observation vector xj = | X(T) Pi t) dt x= 
, 0 , 
XN 


Step 2: Use ML Decoder (Formulation 1, 2, or 3) to find m 
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Matched Filter Receiver 


Inner-product calculator 


Received Observation X Select 
signal vector largest 
x(t) X 


Accumulator 





Matched Sample 
filters att=T 
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Estimate 
m 


Matched Filter Receiver (mathematically) 


T 


. xX 
Xi = | x(t)h(T —t) dt : 
. : ] x2 
Step 1: Find observation vector 0 
xX = 
h(t) = o(T-1) 
we 


Step 2: Use ML Decoder (Formulation 1, 2, or 3) to find m 
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Questions??? Thoughts? ? 


° 


e 
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